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Based on a Monte Carlo simulation, this study is 
designed to investigate the povf;^r of the Kruskal-Wallis' s H^test 
compared to the pover of the F-test for three equal moderate sanple 
sizes dravn at random from distributions of common or different 
shapes but for vhich the population distributions have equal 
variances. The distributions are the Normal, Dniformi^ and Double 
Exponential. It vas found that the F-test is robust to violating 
assumptions of non^normality for sample of size 10, 15, and 20 but 
the pover of H*test is affected b;^ shape of the population 
distributions. The pover of the B-test increase faster vhen all 
samples are dravn from Double Exponential distribution than the pover 
of H-test dravn from all Normal or all Uniform distribution. It is 
also found that the pover of H-test is greater than the pover of the 
F-test vhen all samples are dravn from double exponential 
distribution and the combinations of double exponential and normal 
distributions. The pover of H-test is almost identical to the pover 
of F-test vhen 2 samples are dravn from the double exponential and 
one sample is from the uniform distribution and vhen 3 samples are 
dravn from 3 different shaped distributions. The pover of U-test is 
less than the pover of the F-test vhen all samples are from normal or 
from uniform distributions. (Author/BB) 
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This study, based on a Monte Carlo simulation, is designed to 
investigate the pov/er of the Kruskal-Wallis' s H-test compared to the 
power of the F-test for three equal moderate sample sizes drav^n at 
random from ditributions of common or different shapes but for which 
the population distributions have equal variances. The distributions 
are the Normal, Uniform, and Double Exponential, It was found that 
the F-test is robust to violating assumptions of non-normality 'for 
sample of size 10, 15, and 20 but the power of H-test is affected by 
the shape of the population distributions. The power of the H-test 
increase faster when all samples are drawn from Double Exponential 
distribtion than the power of H-test drawn from all Normal or all 
Uniform distribution. It is also found that the power of H-test is 
greater than the power of the F-test when all samples are dravm from 
double exponential distribution and the combinations of double expo- 
nential and normal distributions. The power of H-test is almost 
identical to the power of F-test when 2 samples are drawn from the 
double exponential aad one sample is from the uniform distribution 
and when 3 samples are drawn from 3 different shaped distributions. 
The power of H-test is less than the power of the P-test when all 
samples are from normal or from uniform distributions The power of 
the H-test is also less than the F-test when 2 samples are dravm from 
uniform and the third is from the normal or exponential distribution. 



Introduction 

The power of test is a means for comparing two methods proposed to test 
the same hypothesis. Relative Efficiency is one procedure used in comparing 



2 

one test with a second test. It refers to the ratio of two nuirbers of obser- 
vations required by each test to have equal power for the same probability of 
Type 1 error. By far the most common index of efficiency is expressed in terms 
of Assymptotie Relative Efficiency ( A.R.E.) which indicates the limiting value 
of the ratio of observations when one value approaches infinity* The A.R.E. 
often provides a compact summary of relative efficiency between two tests but 
its use is limited since it considers infinite sample sizes. However, the 
analytical comparison between two tests is usually found in terms of A.R.E. 
figures. The A.R.E. *s of non- parametric tests compared to their related para- 
metric tests are usually reported for normally distributed population with: few 
indexes reported for the other conditions (see Bradley, 1968, p 6l). Even the 
comparison of the Y/ilcoxon rank sum test with the Normal Scores test is also 
found under normal distribution theory. Lehman (1953, P 23) states that: 

... when comparing different rank tests, one is no" longer 
tied to normal alternatives, but it would on the contrary 
seem rather desirable to make comparisons in terms of 
non-parametric classes of alternatives. 

It would seem that more useful information would be available to the 
practitioner if power comparisons were made under weaker conditions, such as 
test A has greater power than test B when used for morderate sample sizes 
drawn from a symmetric distribution. When a comparison, such as the- two sauple 
Wilcoxon rank sum test compared to the two sample t-test, is made in terms of 
A.R.E. under normal condition it seems as if the models are being compared in 
a general situation but in reality the information refer to infinite sample 
sizes. Thus, the comparison is not useful to the practitioners since infinite 
samples are never selected. 

The Kruskal-Wallis* s H-test is the K-sample generalization of the Wil- 
coxon two-sample test and may be described as the rank analog of the single- 
classification analysis of variance test. The A.R.E. of H-test relative to 
P-test is or .955 in situation where assumptions met for the P-test are 

satisfied. Hodges and Lehman (1956) proved that if the distribution functions 
have identical shape but differ only in location, theA.R.E. of H-test relative 
to P-test is never less than .864 and may exceed 1 for certain type of distri- - 
bution (Connover, p203). A.R.E. of H-test to P-test is 1.00 when, common shape is 
rectangular ^ (Bradley). If the underlying distributions are non-normal, the 
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efficiency of rank test relative to that of the parametric test is always at 
least .864 and is greater than unity for some commonly encountered non-normal 
distribuxions such as the uniform distribution and exponential distribution 
(marascuilo) . 

The purpose of the present study is to compare the power of the H-test 
to the power of the F-test for the fixed-effect one-way MOVA model. The com- 
parison is made under three moderate sample sizes which are drawn from the 
parent distributions in discrete form. , 

Three population distributions are the Normal, Uniform, and Double 
Exponential distributions. The normal distribution is adapted from the table 
of staadard normal scores. The range in X extends from low of 463 to a high 
of 537. The parameters of the distribution are given by a mean of 500 and a 
variance of 100. 05* The uniform distribution is adapted from the formula 
f(x) = l/(b-a), at^ b. The range is 483 - 51? for the distribution 
having mean 500 and variance 100.51- The double exponential distribution is 
obtained from the formula f(u) = ( I/14.I4) e "^/'^•^'^ where -50^ u ^ 50, 
and then transformed to X = 500 + u. The double exponential distribution 
has mean of 500 and variance of 100.06. Thus, the study is based on approxi-- 
mately equal population variances of 100. 

The purpose of the study can be stated specifically by the following 
questions: 

1 . VThat is the power of the H-test compared to the P-test when samples 
are drawn from a common distribution and 

1.1 when all samples are drav/n from a normal distribution? 

1.2 when all samples are drawn from a uniform distribution? 

1.3 when all samples are drav.n from a double exponential 
distribution? 

2. What is the power of the H-test compared to the P-test when samples 
are drawn from different populations with different shapes and 

2.1 when two samples are drawn from normal and another one is 
from a uniform distribution? 

2.2 when tv/o samples are drawn from normal and another one is 
from a double exponential distribution? 

2.3 when two samples are drawn from uniform and the third is 
from normal distribution? 

2.4 when two samples are drawn from uniform and the third is 
from double exponential distribution? 
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2.5 when +wo samples are drawn from double exponential and 
the third is from a normal distribution? 

2.6 v/hen two samples are drav/n from double exponential and 
the third is from a uniform distribution? 

2.7 v;hen one sample is drawn froma normal, one is from a uni- 
form, and another one is from a double exponential distri- 
bution? 

3. How does the size of sample affect the power of the H-test compared 
to the P-xest? 

4. How does the distance betv/een the means of the distributions 
affect the power of the H-test relative to the P-test? 

Procedure 

A CDC 6400 carnputep. was programmer] to call, uniform random numbers from 
a subroutine RAiIP. Let the 1 th random number be assigned by x(l) the numbers 
X(l) were then partitioned into three equal groups according to the specified 
sample sizes NJ. The P-value was computed on the values of the x(l)s but the 
H-value was computed on the RarLk(l) which corresponded to the value x(l). This 
operation was replicated 1000 times- The computer coixnted the P-values and 
H-values v;hich exceeded their critical values for oc = -05 and then listec". them. 
V/hen the null hypothesis was true the computer listed the approximate probabi- 
lity of a type 1 error. The power of the P-test and the H-test were obtained 
when the means of the population distribution were different under the same 
computational scheme. The parameter Delta, 8 j was used to indicate the degree 
of inequality between means and is specified in terms of the standard deviation 
of the population. With this notation, = 500 - S , AC ^ = 500, = 500 +S. 

The power of P-test and H-test was investigated for the case of 3 equal 
sample of size 10, 15, and 20 and for Delta of .25 CT, .50 0", .750", and 1 .00 <r . 

Reisults 

The empirical power of the H-test compared to P-test, for nominaloc= .05, 
is shov/n in table 1 for a number of conditions. The power of the P-test listed 
first and the power of the H-test is listed below in parenthesis. The three 
capital letters listed in the first column denote the shapes of the population 
distributions fromwhich the samples are drawn. The sizes of the samples are 
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shovm on the first row, and the discrepancies between the population means, 
delta, are indicated on the second row. The pair of numbers, .965 and (.956), 
reported in row NUE and column 1.0 S^D. for NJ = 10, are the power of the P-test 
and the H-test.when the first sample is from the Normal, the second is from the 
Uniform, and the third is from the Double Exponential distribution in which the 
mean of the first distribution is -^^^ = 500 - <r = 490, the mean of the second 
distribution is 500, and the mean of the third distribution is = 500 +<r =510. 

Tn order to make the presentation more compact, the symbol as ' power of P-(NUE,10,' 
and ^power of H-(NUE, 10, 1 .o) ' will be used to indicate the pwer of P-test and 
H-test as mention above. 

Table 1 shows, as expected, that the power of P-test and power of H-test 
increase as delta increases. When the comparison is observed across sample 
sizes, the powers increase faster when sample size is larger. 
On the empirical level, of sigiiificanceo 

The empirical level of significance is reported in table 1 for 
Delta = 0. Since the study is based on 1000 replications, for each cell, then 
the standard error for the proportion is about .0067. Thus, the 95^ confidence 
interval for empirical <^ is in the range of .037 to ,063 for the nominal <?C of 
.05. Therefore, the H-test is conservative when applies to the UUU, and EEE 
types of population distributions for sample size of IS? and nominal oc =.05. 
This is also true for P-(EEE, 15, O). 

The comparisons of the power of • .the P-test across the distributions 
with a common shape are shown in figure 1.1, 1.2, and 1.3. The corresponding 
comparisons of the H-test are in figure 2.1, 2.2, and 2.3. 

The power curves of P-(M[,10), P-(UUU,10), and P-(eEE,10) are 
observed in figure 1.1. The shapes of the curves are similar and very close 
together. The shapes and the discrepancy are still close even when the same 
size is 15 or 20 as can be observed in figure 1.2 and 1.3« However, the rate 
of increase in power, along the magnitude of delta, is greater when the sample 
.sizes are increased. These fiegures could lead to the conclusion that P-test 
is robust for violating the assumption of non-normality. 

The comparison of the powers of H-(j}ira,10), H-(UUU,lo), and H-(eEE,10) 
does not hold the same character as those of the P-test. PigTJtre 2.1 shows 
that the power H-(eeE,10) increases faster than power of H-(MW,10), and also 
^ ster than the pov/er of H-(UUU,10). This character is also true for sample 
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size of 15 and 20 which can be seen in figure 2.2 and 2.3 • The shapes of 
power function for H«-.(nM,10), H-.(UUU, 10) , and H-(EEE,10) are not the same. 
Power of H-(NM,10) increases faster than H-(UUU,10) for delta in the range 
of .OS^rto •750'« However, the shape and the discrepancy between power of 
H-<|IM) and H-(UXJU) becpiiess closer when sample sizes are increased. 

The conlcusion can be made at this point that: the power functions 
of P-test are the same for three equal moderate sample sizes drawing from 
all normal, all uniform, and all double exponential distribution but the 
power of H-test obtained from double exponential distribution is greater 
than those obtained from normal or uniform distributions. The shape and 
the discrepancy between power of H-(NM) and H-(UUU) become similar and 
close toger When sample size is larger. 

Pigiares 3.1, 3»2, and 3*3 show the comparison between the power of 
P-(MN) and H-(NT^) for sample sizes of 10, 15, and 20 respectively. The 
shapes of the power curves are the same within the same sample size. Power 
of P is greater than power of H for all sample sizes are larger. 

The comparison of powers between P-(inJU) and H-(UUU) are shown in 
figures 4.1, 4.2 and 4.3. The power of P-(UUU) is also greater than H-(UTJ[j) 
for sample size of 10, 15, and 20. The shapes of P-(UUU,10) and H-(UUU,10) 
are slightly different. Power of P-(UTJU,10) lirtcreafeeB fa§ter when delta 
are in the range .50<Tto .75cr, but when sample size is larger, their 
shapes are more similar and the discrepancy becomes smaller* 

Figures 5.I, 5.2, and 5.3 show the comparison of power of P-test 
and H-test when all samples are drawn from double exponential distribution. 
It appears that pov/er of H-test is greater than the corresponding P-test 
for all sample sizes. The shapes of the power cinrves are similar within 
the same sample size. However, the discrepancies between the power curves 
are slightly larger when sample is of size 20 • 

Figures 6.1 - 11.3 show the comparisons between the actual power 
of the P-test compared to the H-test when samples are drawn from 
populations with different shapes. The comparisons are presented in the 
same procedure. It should be noted here that the pov/er curves for the 

' •'S. 
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P-test and the H-test for sample size of 20 when delta is greater than ^75 
are extrapolated. This is because the powers of the P as well as the H are 
very close to 1.00 when delta is equal to .75 CT. 

Figures 6.1, 6 2, and 6.3 show the power comparisons of P-(iniU) 
and H-(N]JU) and for the sample sizes of 10, 15 and 20 respectively. It 
appears that the power of the P-test increases faster than the H-test for 
sample size 10, 15, and also 20. Their shapes are similar within the 
same sample size. The power comparisons of P-(UUN) versus H-(irroj) are as 
shown in figure 8o1, 8.2, and 8.3 . The results are the same as found 
for P-(mu) versus H-(MU). 

Pigures 7.1, 7.2, and 7.3 arEj -the power comparisons of P-(NinB) 
versus H-(MrE) for sample size 10, 15 and 20 respectively. It is obseiTVed 
that the power curves of P-test and H-test are almost identical. The 
power of H-(ME) is slightly less than P-(N1!JE) for sample size of 10, but 
the power of H-(ME) is slightly greater than P-test when sample size is 
15 and 20. 

The powers of P-(UTJE) versus H-(uue) are shown in figure 9.1, 9.2 
and 9o3 for sample of 10, 15, and 20 respectively. It is observed that the 
power of P-(TJUE) is slightly greater than H-(UTJE). 

Pigures 10.1, 10,2 and 10.3 show the power of P-(EEN) versus 
H-(EEN). The pov/er of H-(em) is almost identical to P-('EEN) for sample 
of 10 but H-(eEIJ) has slightly greater power than P-(EEN) when sample 
sizes are 15 and 20, 

The power comparisons of P-(EEU) with H-(EEU) are shown in figures 
11.1, 11.2 and 11.3. It appears that when the sample size is 10, the power 
of H-(EEU) is slightly less than P-(EEU), but that comes very close together 
for sample sizes of 15 and 20. It is also observed that the power of H-(eEU) 
becomes slightly greater than P-(EEU) when delta is greater than .50. 

Pigures 12.1, 12.2 and 12.3 give almost the same pict\ire as those 
shown in figures 11.1, 11.2 and 11.3. The power of H-(MUE, 15, .75) is .989 
and P-(MJE, 15, .75) is .986. The power of (h-NUE) is slightly more than 
the power of P-(nue) when the sample size is 20 and delta is greater than .50(r 
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In summary, the power of the H-test is slightly greater than the 
P-test when the forms of population are EEE, and EEN, and also ME for sample 
sizes of 15 and 20. The power of the H-test and the P-test are nearly 
identical when the population shapes are EEU, HUE, for sample of sizes 15 
and 2O0 However, the pov/er of H-test is slightly less than P-test when 
populations have the forms imNj MU, UUU, UTIN, And UUE. 
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